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ABSTRACT 

In this paper we systematically study the notions of 
a p-plurisubharmonic function and p-convexity in rie- 
mannian geometry. New facts of a basic nature are 
established. In addition, local p-convexity is shown 
to imply p-convexity (analogous to the Levi problem 
in complex analysis). A level-p version of the Monge- 
Ampere operator is introduced. The solution to the 
Dirichlet problem for all branches of the homogeneous 
level-p Monge-Ampere equation is given. 
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1. Introduction. 

On any riemannian n-manifold there are intrinsic notions of p-plurisubharmonicity and 
p-convexity for integers p between 1 and n. They interpolate between convexity (p = 1) 
and subharmonicity (p = n) with p = n — 1 an important case. They arise naturally in 
many situations. One object of this paper is to give a systematic account of the geometry 
and analysis associated to the ideas in this domain. In part we will gather certain general 
results of the authors, and others, which have particularly nice applications here. We shall 
also establish some new results. 

The central algebraic idea is that of p-positivity for a quadratic form Q on a finite- 
dimensional inner product space V. By definition Q is p-positive if the trace of its restric- 
tion to every p-dimensional subspace W C V satisfies tr |Q| } > 0. This is equivalent to 

the condition that AH h A p > where Ai < • • • < A n are the ordered eigenvalues of Q. 

On any riemannian manifold X : a function u G C 2 (X) is p-plurisubharmonic if its hessian 
is p-positive. An oriented hypersurface in X is p-convex if its second fundamental form is 
p-positive. The Riemann curvature R of X is p-positive if for each tangent vector v, the 
quadratic form (R v ^.-,v) is p-positive. 

The smooth p-plurisubhamonic functions are "pluri"-subharmonic in the following 
sense. 

Theorem 2.10. A function u G C 2 (X) is p-plurisubharmonic if and only if its restriction 
to every p-dimensional minimal submanifold is subharmonic in the induced metric. 

The notion of p-plurisubhamonicity can be generalized to arbitrary upper semi-contin- 
uous [— oo, oo)-valued functions using standard viscosity test functions (cf. [CIL], [C]). For 
p = l,n this recaptures the classical notions of general convex and subharmonic func- 
tions on a riemannian manifold X. The family of p-plurisubharmonic functions, denoted 
PSHp(X), has many of the useful properties of subharmonic functions (see Theorem 7.2). 
Moreover, the Restriction Theorem 2.10 has a non-trivial extension to general, upper semi- 
continuous p-plurisubharmonic functions. 

Theorem 7.3. A function u G PSH p (X) if and only if its restriction to every p-dimensional 
minimal submanifold is subharmonic in the induced metric. 

For each p we introduce a p th Monge- Ampere operator MA P («) given by an explicit 
polynomial in Hess u. These operators interpolate between the Laplace-Beltrami operator 
Ax« = trjHess-u}, for p = n, and the standard Monge- Ampere operator detlHessw} for 
p = 1. One is led naturally to the p th Monge- Ampere problem: To find p-plurisubharmonic 
functions u which satisfy MA P («) = 0. This constitutes the main branch of the problem. 
There is a hierarchy of problems corresponding to other branches of the locus 9Jt p (A) = 
where MA P («) = 97l p (Hess , u) (see Section 3). The solution of the associated Dirichlet 
Problem in all cases will be discussed at the end of the introduction and in Section 9. 

The smooth p-plurisubharmonic functions can be used to introduce a notion of p- 
convexity as follows. Given a compact subset K C X, define the p-convex hull of K to be 
the set K of points x G X such that 

u(x) < supu 

K 
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for all smooth p-plurisubharmonic functions uonl. Then X is said to be p-convex if 

K CC X K CC X. 

We have the following result. 

Theorem 4.4. A riemannian manifold X is p-convex if and only if X admits a smooth 
p-plurisubharmonic proper exhaustion function. 

A domain ficlis said to be locally p-convex if each point x G 90 has a neighborhood 
U such that QnU is p-convex. Note that p-convex domains are locally p-convex (see (4.1)). 
The following converse is an analogue of Levi Problem in complex analysis, and is one of 
the new results of this paper. 

Theorem 4.7. Let O CC R n be a domain with smooth boundary. If O is locally p-convex, 
then O is p-convex. 

There is also a notion of p-convexity for the boundary. Let II denote the second 
fundamental form of the boundary 90 with respect to the interior normal. Then the 
boundary 90 is p-convex if II x is p-positive at each point x G 90. 

Theorem 4.9. Let O CC R n be a domain with smooth boundary. If O is locally p-convex, 
then <90 is p-convex. 

From Theorem 4.10 one then concludes that for such domains O, 

O is p-convex -<=>- O is locally p-convex -<=>- 90 is p-convex. 

A quadratic form A on an inner product space V is said to be strictly p-positive if 
tr {Aj^} > for all p-planes W C V. This gives notions of strict p-plurisubharmonicity, 
strict p-convexity, etc. In Section 5 a number of results concerning strictly p-convex do- 
mains and strictly p-convex boundaries are given. A key concept here is that of the core 
of X, a subset which governs the existence of strictly p-plurisubharmonic functions and 
proper exhaustions (see Theorem 5.4.) The core contains all compact minimal subman- 
ifolds without boundary in X . When X is p-convex and the core is empty, X admits a 
strictly p-plurisubharmonic proper exhaustion function, and standard Morse Theory im- 
plies that X has the homotopy-type of a complex of dimension < p — 1 (cf. [Si], [Wu]). 
Strict p-convexity of the boundary 90 implies that the core is compact and there exists a 
p-plurisubharmonic proper exhaustion of X which is strict outside a compact set. When 
the boundary is only p-convex, similar conclusions hold if the riemannian curvature is 
strictly p-positive near 90. This result of H. Wu [Wu] is given in Theorem 5.9. 

In Section 6 the relationship of p-plurisubharmonic functions to minimal submanifolds 
and currents is explored. A p-dimensional rectifiable current T G 1Z P (X) on X is called 
minimal if the first variation of the mass of T is zero with respect to deformations supported 
away from its boundary 9T (see Definition 6.1). 

Corollary 6.5. Suppose T G 1Z P (X) is a minimal current, and let u be any smooth 
p-plurisubharmonic function which vanishes on a neighborhood of supp(9T). Then 

tr^-(Hess'u) =0 on supp(T). 
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IfT = [M] is the current associated to a connected p-dimension minimal submanifold, and 
if the p-plurisubharmonic function u and its gradient both vanish at points of dM, then 

it | = or, if dM =0,it| = constant. 

Corollary 6.6. Let K C X be a compact subset and suppose T G 1Z P (X) is a minimal 
current such that supp(<9T) C K. Then 

supp(T) C KUCore(X). 

This leads to the notion of a minimal surface hull of a compact set K C X, namely the 
union of the supports of all minimal currents T G TZ P (X) whose boundaries are supported 
in K. By Corollary 6.6, this hull is contained in K U Core(X). 

Much of this discussion carries over to minimal (non-rectifiable) p-currents. 

In Section 8 viscosity solutions of the various branches of the homogeneous p th Monge- 
Ampere equation are discussed. 

In Section 9 the solution to the Dirichlet problem for this equation is presented. 

Theorem 9.1. Let QccI be a strictly p-convex domain with smooth boundary <9fi in 
an n-dimensional riemannian manifold X. Fix an integer k with 1 < k < (™). Then for 

each continuous function <p G C(dQ), there exists a unique function u G C(0) such that: 

(a) u\ Q is a solution of the k th branch of the homogeneous p th Monge- Ampere equation, 

(b) u\ dn = < p. 

Solutions of certain inhomogeneous equations also exist. 

In Appendix A the extreme points in the cone V P (V) of p-positive quadratic forms in 
Sym 2 (V) are classified. 

Finally we note that the basic notions of p-plurisubharmonicity and p-convexity make 
sense with the grassmann bundle G(p,TX) replaced by a closed subset <& C G(p,TX). 
There are surprisingly many results which hold in the general context of a "(E-geometry" . 
They are discussed in a separate but companion paper [HLg]. 



2. Plurisubharmonicity. 
Euclidean Space. 

Suppose V is an n-dimensional real inner product space, and fix an integer p, with 
1 < p < n. Let Sym 2 (V) denote the space of symmetric endomorphisms of V. Using the 
inner product, this space is identifies with the space of quadratic forms on V. The notion 
of p-plurisubharmonicity for a smooth function u on V is defined by requiring that its 
hessian (i.e., second derivative) belong to a certain subset V P (V) C Sym 2 (V). To better 
understand this subset we offer several (equivalent) definitions. 

Definition 2.1. Suppose A G Sym 2 (U). Then A G V P (V), or A is p-positive, if the 
following equivalent conditions hold. 

(1) tr w A > for all W G G(p, V) 



4 



(2) 



X 1 (A) + ■ ■ ■ + X P (A) > 



(3) 



D A > 



where: 



(1) G(p, V) denotes the set of p-dimensional subspaces of V, and for W G G(p,V), 
the VF-trace of A, denoted tx w A, is the trace of the restriction A\ w of A to W, 

(2) Xi(A) < • • • < X n (A) are the ordered eigenvalues of A, so Condition (2) says that 
the sum of the p smallest eigenvalues is > 0, 

(3) Da : A P V — > A P V is the linear action of A as a derivation on the space A P V of 
p- vectors, i.e., on simple p- vectors one has 

D A {v\ A ■ ■ • A v p ) = (Avi) A v 2 A • • • A v p + V\ A (At> 2 ) A • • • A i; p + V\ A v 2 A • • • A (Av p ). 

The inner product on V induces an inner product on APV, and we have Da G 
Sym 2 (A p V), so the notions of non-negativity, Da > 0, and positive definiteness, Da > 0, 
make sense for Da- 

The proof that condition (1), (2) and (3) are equivalent will be given below. 

Definition 2.2. (p-plurisubharmonicity). A smooth function u defined on an open 
subset X C R n is said to be p-plurisubharmonic if D 2 x u = Hess^-u G V p (R n ) for each 
point x G X. 

The next result justifies the terminology. 

Proposition 2.3. A function u G C°°(X) is p-plurisubharmonic if and only if the restric- 
tion u\ WnX is subharmonic for all afEne p-planes W C R n . (Here "subharmonic" means 
that Aw ( u \\y n x) — w here A\y is the euclidean Laplacian on the afEne subspace W). 

Proof. This is obvious from Condition (2) since with v = u \ WnX > we have tr\yD 2 u = Ayyv 
on wnx. ' ' ■ 

Remark 2.4. The endpoint cases are classical. 

(p = 1) Convex Functions. Note that A G V\ A min (A) > A > 0, so that 

u is 1-plurisubharmonic <^=^> u is convex. 

(p = n) Classical Subharmonic Functions. Note that A G V n <^=^> trA > 0, so that 
u is n-plurisubharmonic <^==^> Au > 0, i.e., u is classically subharmonic. 

Consequently, the simplest new case is when p — 2 in R 3 where u is 2-plurisubharmonic 
<^=^ the restriction of u to each affine plane in R 3 is classically subharmonic. One 
generalization of this case has an interesting characterization. 

(p = n — 1) If p = n — l, then * : A 1 V — > A n ~ 1 V is an isomorphism. This induces 
an isomorphism Sym 2 (A n ~ 1 V) — > Sym 2 (A 1 y) sending Da >->■ (trA)/ — A. Therefore 
u G C°°(X) is n — 1-plurisubharmonic if and only if 



(Ait)/ — Hess u > 0. 



5 



Note. 

(a) It is obvious from Condition (2) that V P (V) C V p +i(V), or equivalently, if u is p- 
plurisubharmonic, thenu is (p+l)-plurisub harmonic. In particular, each p-plurisubharmonic 
function is classically subharmonic, and every convex function is p-plurisubharmonic for 
all p. 

(b) The set V P (V) is a closed convex cone with vertex at the origin. 

The proof of the equivalence of Conditions (1), (2) and (3) in Definition 2.1 requires 
some elementary facts. Note that each p-plane W C V determines a line L(W) C A P V ', 
namely the line through v\ A • • • A v p where vi, v p is any basis for W. If e±, e n is an 
orthonormal basis of V, we set ej = A • • • Aei p for I = (ii, i p ) with %\ < %i < • • • < i p . 

Lemma 2.5. Given A G Sym 2 (V), consider D A e Sym 2 (A p V). Then we have: 

(a) For all W G G(p, V), 

tr w A = lr L{w) D A . (2.1) 

(b) If A has eigenectors ei,...,e n with corresponding eigenvalues Ai, X n , then Da 
has eigenvectors ei with corresponding eigenvalues 

Xj =X h + ---X ip . (2.2) 



Proof. For (a), note that, if ei,...,e p is an orthonormal basis of W, then tr L ( W ^DA = 
(D A (eiA- ■ -Aep),eiA- • -Ae p ) = J2] =1 (eiA- ■ -AAejA- ■ -Ae p , dA- ■ -Ae p ) = Yl™=i( Ae ji e j) = 
tr^A For (b), compute D A ei = Ajej. ■ 

Corollary 2.6. Suppose A e Sjm 2 (V) has ordered eigenvalues X\(A) < • • • < A n (A). 
Then 

inf tr w A = X t (A) + ■ ■ ■ + X P (A) = X min (D A ), (2.3) 
weG(p,w) 

the smallest eigenvalue of D A . 

Proof. Since D A has eigenvalues A/ by part (b), the smallest is Xi(A) + ■ ■ ■ + X P (A) = 
tr L( yy^D A where W = span {ei, e p }. Now the smallest eigenvalue of D A equals the 
infimum of tr lD a over all lines in A p V, so in this case it is also the infimum over the 
restricted set of lines of the form L(W) with W e G(p, V). By part (a), this proves (2.3) .■ 

The equivalence of Conditions (1), (2) and (3) in Definition 2.1 is immediate from 
Corollary 2.6. 

Definition 2.7. (p-Harmonic). A smooth function u defined on an open subset X C R n 
is p-harmonic if D 2 u G dV p for all x G X, or equivalently if X m i n (DH x ) = 0, where 
H x = D 2 u, for all x G X . 

Example 2.8. (Radial Harmonics). 

(p = 1) The function \x\ is 1-harmonic on R n — {0}. 

(p = 2) The function log | x | is 2-harmonic on R n — {0}. 

(3 < p < n) The function — , is p- harmonic on R n — {0}. 
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Proof. If u{x) = \x\, then 



Uessu = l-fl-^-o^). (2.4) 



1AV \ <Xj tXj 



If it (a;) = log I a; I , then 



Hessw = *(ll-*o£rY (2.5) 
If u(x) = — l/\x\ p ~ 2 , then 

Hessiz = {P ~ 2)P (ll-*o*). (2.6) 
\x\ p \p \x\ \x\J 

Note from (2.4) - (2.6) that the hessian of it is a scalar multiple of H = ^ ■ I — eo e where 
e = |^y. The eigenvalues of H are | — 1 = and | occurring with multiplicity n — 1. 

This implies that the eigenvalues of D H are and 1, and in particular, A min (.D#) =0. ■ 

Remark 2.9. For each of the radial functions u in Example 2.8, if 2 < p < n — 1, the 
hessian Hess^ generates an extremal ray in the cone V + (See Appendix A). 



Riemannian Manifolds. 

Suppose X is an n-dimensional riemannian manifold. Then the euclidean notions 
above carry over with V = T X X and the ordinary hessian of a smooth function replaced 
by the riemannian hessian. For u G C 2 (X) this is a well defined section of the bundle 
Sym 2 (TA) given on tangent vector fields V, W by 

(Hessu)(V, W) = VWu- (V v W)u, (2.7) 

where V denotes the Levi-Civita connection. Acting as a derivation, it determines a well 
defined section Dn essu of Sym 2 (A p TX) for each p, 1 < p < n. 

Definition 2.2' (p-plurisubharmonicity). A smooth function u on X is said to be 
p-plurisubharmonic if Hess x w is p-positive at each point x E X (see Definition 2.1). 

The appropriate geometric objects for restriction are the p-dimensional minimal (sta- 
tionary) submanifolds of X. In the euclidean case this enlarges the family of affine p-planes 
used in Proposition 2.3 when 1 < p < n. 

THEOREM 2.10. A function u G C 2 (X) is p-plurisubharmonic if and only if the 
restriction of u to every p-dimensional minimal submanifold is subharmonic. 

Proof. Suppose M C X is any p-dimensional submanifold, and let Hm denote its mean 
curvature vector field. Then 

Am Hm) = tr TMHess u - H M u. (2.8) 
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In particular, if M is minimal, then 



a m(u\ m ) = tr TM Hess-u. (2.9) 

It is an elementary fact that for every point x G X and every p-plane W C T X X, there 
exists a minimal submanifold M with T X M = £. This is enough to conclude Theorem 2.10 
from (2.9). ■ 



3. The p Monge- Ampere Operator. 

Given A G Sym 2 (F), the determinant of Da G Sym 2 (A p V) defines a homogeneous 
polynomial of degree (™) on Sym 2 (V). 

Definition 3.1. The p th Monge-Ampere polynomial on the vector space Sym 2 (V) is 
defined by 

MA p (A) = deW A = ]] A/(,D (3.1) 

ii<---<i p 

(where A/ (A) = A^(A) + ■ • • + \ P {A) as before). The corresponding operator on smooth 
functions u, namely 

MA p («) = detDnessu = If A/ (Hess u) (3.2) 

ii<---<i p 

will be referred to as the p th Monge-Ampere operator. 
Examples. 

(p = 1) MAi(tt) = det(Hess'u) is the standard Monge-Ampere operator. 
(p = n) MA„(«) = Au is the Laplacian. 
(p = n - 1) MA n _i(«) = det((Au) • I - Hess-u) 

Definition 3.2. A smooth function u is said to satisfy the homogeneous p th Monge- 
Ampere equation if 

u is p-plurisubharmonic and MA p («) = 0. 

Proposition 3.3. A smooth function satisfies the homogeneous p th Monge-Ampere equa- 
tion if and only if it is p-harmonic (see Definition 2.7). 

Note 3.4. In particular each of the radial harmonics given in Example 2.8 is a solution 
of the homogeneous p th Monge-Ampere equation. 

Proof. H = Ress x u G dV p H G V v and MA p (if) = 0, since 

lntV p (V) = {A G Sym 2 (F) : A 7 (A) > for all |/| = p} (3.3) 

These definitions clearly carry over to any riemannian manifold A, and we have the 
following. 
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Proposition 3.5. Suppose u G C°°(X) is strictly p-plurisubharmonic. Then the lin- 
earization of MA p at u is elliptic. 

Proof. Fix a G X and geodesic normal coordinates (xi,...,x n ) at a with x(a) = 0. We 
may assume the coordinate axes are eigendirections of Hessow so that at 

n 

Hess-u = Xjej o ej 
i=i 

where by assumption Xj > for all j. It follows that 

^Hessu = ^2^I e I ° e I 
I 

at 0, with notation as above. One now computes that 



d 1 

— {det (D Uess(u+tv) ) } = V — tr ?J (Kessv) 
at t=0 \i 



where = spane/ is the coordinate /-plane. In particular if i] = ^2 ■ r/jdxj is a cotangent 
vector at 0, then the principal symbol of the linearization L U (MA P ) of MA P at u is 



a v (L u {MA p )) = ^^|r?/| 2 
i Xl 

where r\j = X^e/ ^j e j- Evidently a v (L/(MA p )) = iff rj = 0. ■ 

Much can be said about solving the p th Monge- Ampere equation as well as a larger 
family of equations which we now describe. 

Other Branches of the Homogeneous p th Monge-Ampere Equation. Fix 1 < p < 

n. For each integer k, with 1 < k < (™), let V p k \v) C Sym 2 (V) denote the subset of 

A G Sym 2 (V) such that the k th smallest p-fold sum of its eigenvalues is > 0. That is, if 
the ordered eigenvalues of Da are Xi 1 (A) < • • • < Xi N (A), where N = (™), then 

Vj ] k \V) = {AeSjm 2 (V):X Ik (A)>0}. 

Note that V^\v) C vf> \V) C • • • C V^\v) and (V) = V P (V). The remaining sets 
Vp k \v), k > 1 are not convex. However, the important fact here is that 

V™(V) + V P (V) c V^(V), 

which follows easily from Definition 2.1(3) since A > =>- Da > 0. This fact implies the 
positivity condition needed for potential theory and the Dirichlet problem, namely 

V ( p k) (V) + Vi(V) c V ( p k) (V). 
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The zero set of MA p is just the union of the boundaries 

{MA P (A) = 0} = |J dV p (k) (3.4) 

i<k<(;) 

Definition 3.6. A C 2 -function on an open set X C R n is said to satisfy the k th branch 
of the p th Monge- Ampere equation if 

Hess x -u G dV { v k) for all x G X. 

Our solution to the Dirichlet problem for this equation will be discussed in Section 9. 

4. Convexity, Boundary Convexity, and Local Convexity 
Riemannian Manifolds 

Let PSH^°(A) denote the smooth p-plurisubharmonic functions on a riemannian man- 
ifold X. 

Definition 4.1. Given a compact subset K C X, the p-convex hull of K is the set 

K = {xGl: u(x) < supw for all u G PSH^°(A)} 

K 

Proposition 4.2. If M C X is a compact connected p-dimensional minimal submanifold 
with boundary dM ^ 0, then 

M c dM. 

Proof. Apply Theorem 2.10 and the maximum principle for subharmonic functions on M. 
■ 

Definition 4.3. We say that X is p-convex if for all compact sets K <Z X, the hull K is 
also compact. 

THEOREM 4.4. Suppose X is a riemannian manifold. Then: 

(1) X is p-convex 

(2) X admits a smooth p-plurisubharmonic proper exhaustion function. 

Proof. See Theorem 4.4 in [HLg] for the proof. It is exactly the same proof as the one 
given for Theorem 4.3 in [HLi]. ■ 

Condition (2) can be weakened to a local condition at oo in the one-point compacti- 
fication X — X U {oo}. This follows from the next lemma. 

Lemma 4.5. Suppose that X — K admits a smooth p-plurisubharmonic function v with 
lim^oo v(x) = oo where K is compact. Then X admits a smooth p-plurisubharmonic 
proper exhaustion function which agrees with v near oo. 
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Proof. This is a special case of Lemma 4.6 in [HL 8 ]. 



Euclidean Space. 

We now show that the p-convexity of a compact domain with smooth boundary in 
euclidean space is a local condition on the domain near the boundary. This result is to 
some degree analogous to the Levi Problem in complex analysis. 

Definition 4.6. A domain O C R n is locally p-convex if each point x G 90 has a 
neighborhood U in R n such that O n U is p-convex. 

Each ball in R n is p-convex, and the intersection of two p-convex domains is again 
p-convex. Therefore 

If O is p — convex, then O is locally p — convex. (4.1) 
Our main result is the converse. 

THEOREM 4.7. Suppose that O is a compact domain with smooth boundary. If O is 
locally p-convex, then O is p-convex. 

Intermediate between local and global convexity is the notion of boundary convexity. 
Suppose now that 90 is smooth. 

Denote by II = Ildn the second fundamental form of the boundary with respect to 
the inward pointing normal n. This is a symmetric bilinear form on each tangent space 
T x dQ defined by 

IIon(v,w) = -(S7 v n,w) = (n,V v W) 
where W is any vector field tangent to 90 with W x = w. 

Definition 4.8. The boundary 90 is p-convex at a point x if tiw{HdCi} > for all 
tangential p-planes W C T x (90) at x. 

Theorem 4.7 is the compilation of the following two results. 
THEOREM 4.9. If the domain O is locally p-convex, then its boundary 90 is p-convex. 
THEOREM 4.10. If the boundary 90 is p-convex, then the domain O is p-convex. 

Before proving these two theorems we make some remarks on boundary convexity. 

Remark 4.11. (Local denning functions). Suppose p is a smooth function on a 
neighborhood B of a point x G 90 with 90 n B = {p = 0} and O H B = {p < 0}. If dp 
is non-zero on 90 D B, then p is called a local denning function for 90. It has the 
property that 

D 2 x p = \Vp{x)\II x (4.2) 

on 90flS. To see this, suppose that e is a vector field tangent to 90 along 90, and note that 
II{e,e) = (n, V e e) = -^(Vp,V e e) and -(Vp,V e e) = -(V e e)(p) = e(ep) - (V e e)(p) = 
(D 2 p)(e, e). As a consequence we have that 90 is p-convex at a point x if and only if 

trwD^p > for all p— planes W tangent to 90 at x (4.3) 
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where p is a local denning function for 90. Moreover, (4.3) is independent or the choice 
of local defining function. 

Remark 4.12. (Principal curvatures). Let k\ < ■■■ < n n -i denote the ordered 
eigenvalues of II X . Then we have that 

90 is p — convex at x •<=>- K\ + • • • + k p > 0. (4-4) 

Proof. Apply Corollary 2.6 to A = II with V = T x 90. ■ 

We now give the proof of Theorem 4.9, that local p-convexity implies boundary p- 
convexity. 

Lemma 4.13. If 90 is not p-convex at a point x G 90, then there exists an embedded 
minimal p-dimensional submanifold M through the point x with 

M — {x} C in a neighborhood of x. (4-4) 

Proof of Theorem 4.9. Assume that 90 is not p-convex at a point x G 90. Let B 
denote the e-ball about x. It suffices to show that n B is not p-convex. This is done by 
constructing a "tin can" inside B using Lemma 4.13. We can assume that M is a compact 
manifold with boundary and M C B. 

Let M t = M+tu denote the translate of M by tv where v is the outward-pointing unit 
normal to 90 at x. Choose r > sufficiently small that each M t C for — r < t < 0. Let K 
denote the "empty tin can" consisting of the "bottom" M_ r and the "label" |J- r <t<o 

dM t . 

Then K is a compact subset of n B. Let K be its p-convex hull in n B. 

Since dM t C K, Proposition 4.2 implies that each M t C K for — r < t < 0. Since K is 
closed in O fl B, this proves that x must be in the R n -closure of K, i.e., K is not compact. 
Hence, O fl B is not p-convex. ■ 

Proof of Lemma 4.13. Suppose 90 is not p-convex at x. Then there is a tangent p-plane 
W to 90 at x with 

tr w {II dQ } < 0. (4.6) 

We may assume that W is the plane spanned by eigenvectors of i7 with the smallest 
eigenvalues. We can then choose euclidean coordinates (£i, ...,t n ) with respect to an or- 
thonormal basis e±, e n so that: 

(i) x corresponds to the origin 0, 

(ii) n = e n is the outward pointing normal to O at x. 

(iii) ei, e n -i are the eigenvectors of iT at x with eigenvalues k\ < k,2 < • • • < K n -i 

(iv) W = span{ei,...,e p } 

In a neighborhood of our domain can be written as 

O = {t n < /(*!,..., t n _l)}. 
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In particular, p(t) = t n — f(ti, £ n _i) is a local denning function for 90 near G 90. 
By Remark 4.11, since (Vp)(0) = e n is a unit vector, 

D 2 p = -Do 2 / = II . (4.7) 

Hence / has Taylor expansion 

fit) = -±( Kl tj + --- + Kn - 1 t 2 n _ l ) + 0(\t\ s ). (4.8) 

By setting c = — + • — h ftp) we obtain a diagonal matrix diag(^i + c, k p + c) with 
trace zero. The hypothesis (4.6) is equivalent to c > 0. 

We now restrict attention to the linear subspace P = span {e±, e p , e n } = W © 
Re n , and consider graphs {t n = g(ti, ...,t p )} which are minimal hypersurfaces in P (and 
therefore in R n ). We apply the following basic lemma, whose proof is left as an exercise. 

Lemma 4.14. Given A G Sym 2 (R p ) with tiA = 0, there exists a real analytic function g 
defined near the origin with g(0) = 0, (Vg)(0) = and D$g = A such that g satisfies the 
minimal surface equation. 

We can apply this lemma with A = — diag(«i + c, k p + c) obtaining a minimal 
surface M = {(t,g(t)) e P = R p+1 : \t\ < r]} C R n . The hypothesis c > implies that 
g(t) < /(ti, ...,t p , 0, 0) if < \t\ < r] small. This implies that M - {0} C O, completing 
the proof of Lemma 4.13 and Theorem 4.9 as well. ■ 

Now we commence with the proof of Theorem 4.10. Let 8(x) denote the distance 
from a point x G O to the boundary 90. By the e-collar of 90 we shall mean the set 
{x G O : < 5(x) < e}. Theorem 4.10 is immediate from the next result. 

Proposition 4.15. 

(1 ) If 90 is p-convex on a neighborhood ofxo G 90, then — \og8(x) is p-plurisubharmonic 
on the intersection of a neighborhood of Xq in R n with an e-collar of 90. 

(2) If —\og8(x) is p-plurisubharmonic on an e-collar of 90, then O is p-convex. 
Summary 4.16. From this proposition and Theorems 4.9 and 4.10 we conclude that 

O is locally p — convex <^=^> 90 is p — convex 

<^=^> — logS(x) is p — plurisubharmonic (4-9) 
<^=^> O is p — convex 

Proof of (1). Let II denote the second fundamental form of the hypersurfaces {5 = e} 
for e > 0, and let n = V5 denote the inward-pointing normal. An arbitrary p-plane V at 
a point can be put in a canonical form with basis 

(cos 9)n + (sin6>)ei, e2, e p 

where orthonormal. Set W = span{ei, e p }, the tangential part of V. 
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Lemma 4.17. 



try Hess(— logS) = - sin 2 6trw{H) + cos 2 9 



Proof. See Remark after Proposition 5.13 in [HLi]. 



Note. This formula holds on any riemannian manifold. 

If II has eigenvalues k±, n n -i at a point x G <90, then let Ki(8), n n -i(8) denote 
the eigenvalues of II at the point a distance 5 from x along the normal line. A proof of 
the following can be found in [GT, §14.6]. 

Lemma 4.18. For small 5 > one has 



Corollary 4.19. Each Kj(5) is strictly increasing if Kj ^ and = if Kj = 0. 

We now combine Lemma 4.17 with Corollary 4.19 to conclude that — logd is p- 
plurisubharmonic. 

Remark 4.20. Note that each <9fi e , where Q e = {5 > e}, is strictly p-convex and — log5 
is strictly p-plurisubharmonic if and only if 90 has no p-flat points, i.e., points where the 
nullity of IIbu is > p. 

Proof of (2). By Theorem 4.4 it suffices to prove the existence of a continuous exhaustion 
function u : O — > R + which is smooth and p-plurisubharmonic outside a compact set in 
O. Such a function is given by setting u{x) = max{— \og5(x), — log(e/2)}. ■ 



Let X be a riemannian manifold. 

Definition 5.1. We say that a function u E PSH^°(X) is strictly p-plurisubharmonic 

at a point x G X if Hess x w G IntV p (T x X), i.e., if one of the following equivalent conditions 
holds. 

(1) tr w lless x u > for all W G G(p,T x X). 

(2) Ai(Hess :E 'u) + • • • + A p (Hess :E w) > 0. 

(3) D HesSxU >0. 

Definition 5.2. The manifold X is called strictly p-convex if it admits a proper 
exhaustion function u : X — > R which is strictly p-plurisubharmonic at every point, 
and it is called strictly p-convex at infinity if it admits a proper exhaustion function 
u : X — > R which is strictly p-plurisubharmonic at infinity. 

Definition 5.3. The p-core of X is defined to be the subset 




n-1. 



5. Strict Convexity. 



Core p (X) 



{x G X : u is not strict at x for all u G PSH^°(X)} 
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THEOREM 5.4. Suppose X is a riemannian manifold. 

(1) X admits a smooth strictly p-plurisubharmonic function -<=>- 

Core(X) = 0. 

(2) X is strictly p-convex, i.e., X admits a smooth strictly p-plurisubharmonic proper 
exhaustion function -<=>- 

Core(X) = and X is p-convex. 

(3) X is strictly p-convex at infinity •<=>- 

Core(X) is compact and X is p-convex. 

Proof. Part (1) is a special case of Theorem 4.2 in [HLg]; Part (2) is a special case of 4.8 
in [HLg]; and Part (3) is a special case of Theorem 4.11 in [HLg]. ■ 

Proposition 5.5. Every compact p-dimensional minimal submanifold M without bound- 
ary in X is contained in Core p (X). If instead the boundary dM ^ and M is connected, 
then 

M C dM. 



Proof. For the first assertion, apply Theorem 2.10 and the maximum principle to conclude 
the restriction of any smooth p-plurisubharmonic function to M is constant. The second 
assertion is Proposition 4.2. ■ 
This provides an analogue of the support Lemma 3.2 in [HL2]. 

Corollary 5.6. Suppose M C X is a compact p-dimensional minimal submanifold with 
possible boundary. Then 

M C dM UCore(X). 

The following is a well known result of Sha [Si] and Wu [Wu]. It is also an easy special 
case of Theorem 6.2 in [HLi] (see also Theorem 4.16 in [HLg]). 

Proposition 5.7. If X is strictly p-convex, then X has the homotopy-type of a complex 
of dimension < p — 1 . 

Proof. Let / : X — > R be a strictly p-plurisubharmonic exhaustion function, and by 
approximation assume that / has non-degenerate critical points. We claim that at any 
critical point x G X the index of Hess/ is < p — 1. If not, there must be a subspace 
V C T X X of dimension >pon which Hess/ is < 0, contrary to assumption. ■ 



Proposition 5.8. Let Q C X be a domain with a smooth boundary dQ which is strictly 
p-convex, i.e. trw {IIqq} > for all p-planes tangent to <9fi. Then O is strictly p-convex 
at infinity. Furthermore, if Core(X) = 0, then O is strictly p-convex. 

Proof. The strict p-convexity of the boundary implies that the function — \og8(x) is strictly 
p-plurisubharmonic on a collar of dQ in Q using Lemma 4.17 (which holds on riemannian 
manifolds). Now apply Lemma 4.5. The second statement follows from Theorem 5.4 (2). 
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The case of a domain fid with a (not necessarily strict) p-convex boundary is more 
delicate. In the euclidean case treated in Section 4 we required an exact calculation of the 
second fundamental form of the equidistant sets to the boundary (Lemma 4.18). In the 
general riemannian case this calculation involves Jacobi fields along geodesies emanating 
normally from the boundary. This requires a condition on the Riemann curvature tensor. 

To each unit tangent vector e G T X X there is a quadratic form K e e Sym 2 (T x X) given 
by K e (v) = ||i>|| 2 .KT(e A v) where K(e A v) denotes the sectional curvature of the 2-plane 
span{e,v}. The curvature of X is said to be p-positive (or strictly p-positive) if K e is 
p-positive (or strictly p-positive) for all e. 

THEOREM 5.9. (H. Wu [Wu]). Let O C X be a domain with a smooth p-convex 
boundary <9fi. If the curvature of X is strictly p-positive in a neighborhood of dVt, then Q 
is strictly p-convex at infinity. Moreover, if the curvature is p-positive on Q and either 

(a) curvature of X is strictly p-positive on a neighborhood of dfl, or 

(b) the boundary dfl is strictly p-convex, 
then Q is strictly p-convex. 

Related results have been proved by J-Ping Sha [Si]. 

It is natural to raise the existence question for p-convex domains. The next three 
results give particularly nice answers. 

Proposition 5.10. Let N C X be any compact submanifold without boundary of dimen- 
sion < p — 1. Then f(x) = dist(x, N) 2 is strictly p-plurisubharmonic in a neighborhood of 
N. 

Proof. See the proof of Theorem 6.4 in [HLi]. ■ 

THEOREM 5.11. Let N C X be any (not necessarily compact) submanifold of di- 
mension < p — 1. Then N has a fundamental neighborhood system of strictly p-convex 
domains. 

Proof. See the proof of Theorem 6.4 in [HLi] (see also Theorem 4.17 in [HL 8 ]). ■ 

THEOREM 5.12. (J.-P. Sha [S 2 ]). Let ficclbea domain with a smooth, strictly 
p-convex boundary. Suppose O' CC I is a domain with smooth boundary constructed 
from O by attaching a handle of dimension < p — 1 along the exterior side of Q. Then O' 
is ambiently isotopic to a domain with strictly p-convex boundary. 

6. Minimal Varieties and their Associated Hulls. 

In this section we introduce the minimal current hull of a compact set K in a rieman- 
nian manifold X, and relate it to the p-convex hull K discussed in §4. This hull will be 
defined using the group 1Z P (X) of p-dimensional rectifiable currents with compact support 
in X (cf. [F], [Si], [M], etc.). These creatures enjoy many nice properties. They can 
be usefully considered as compact oriented p-dimensional manifolds with singularities and 
integer multiplicities, and readers unfamiliar with the general theory can think of them 
simply as sub manifolds. 
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Of importance here is the following general structure theorem. Associated to each 
T G 7Zp(X) is a Radon measure ||T|| on X and a ||T||-measurable field of unit p- vectors 2* 
such that for any smooth p-form won I, 

T(u) = ( u(f)d\\T\\. (6.1) 
Jx 

(Recall [deR] that the p-currents are the topological dual space to the space of smooth 
p-forms.) In particular, every T G TZ P (X) has a finite mass 

M(T) = / d||T||. 
Jx 

Example. When T corresponds to integration over a compact oriented submanifold with 
boundary, of finite volume M C X, one has ||T|| = Ti p \ M (V. p = Hausdorff measure), 
corresponds to the oriented tangent plane T X M, and M(T) = H P (M) = the riemannian 
volume of M. 

Definition 6.1. A current T G 1Z p (X) is called minimal or stationary if for all smooth 
vector fields V on X which vanish on a neighborhood of the support of <9T, one has 



±M((<p t ).T)) 



= 0, (6.2) 

t=o 



where <p t denotes the flow generated by V on a neighborhood of the support of T. 

Each smooth vector field on X defines a smooth bundle map A v : TX — > TX given 
on a tangent vector W by 

A V (W) = V W V. (6.3) 

This determines the derivation D A v : A P TX -)> A P TX as in Section 2. Proof of the 
following can be found in [LS] or [L] . 

THEOREM 6.2. (The First Variational Formula). Fix T G TZ p (X) and let V, ip t 

be as above. Then 



I (D AV f,f)d\\T\\ = I i^(A v )d\\T\\ (6.4) 



t=0 

Suppose now that V = V« for a smooth function tionX Then 

^ Vu = Hess-u, (6.5) 

considered as an endomorphism of TX. To see this note that (A Vu (W), U) (V^/(V , u), U) = 
W{Vu, U) - (Vu, V W U) = (WU - V w U)u = (Hess u)(W, U). Hence, we have the follow- 
ing. 
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THEOREM 6.4. IfV = Vu, then 



t=o Jx 



I tr^ (Hessu)d||T|| (6.6) 



Corollary 6.5. Suppose T e 1Z P (X) is a minimal current, and let u be any smooth 
p-plurisubharmonic function which vanishes on a neighborhood of supp(<9T). Then 

tr-^ (Hess it) = on supp(T). 

IfT— [M] is the current associated to a connected p-dimension minimal submanifold, and 
if the p-plurisubharmonic function u and its gradient both vanish at points of dM, then 

it | = or, if dM = 0, u\ M = constant. 

Proof. The first statement follows directly from (6.2), (6.6) and the fact that trvi/Hessu > 
on all tangent p planes W. Now when T = [M] for a minimal submanifold M, we 
have tr TxM (HesSa;tt) = A M (u\ M ) where A M is the Laplace-Beltrami operator of M in the 
induced metric (see Proposition 2.10 in [HLi]). Hence, u\ M is harmonic on M with constant 
boundary values (if dM ^ 0). The conclusion follows from the maximum principle. ■ 

Corollary 6.6. Let K C X be a compact subset and suppose T e 1Z P (X) is a minimal 
current such that supp(9T) C K. Then 

supp(T) C KUCore(X). 

Proof. Suppose x K. Then by the p-plurisubharmonic analogue of Lemma 4.2 in [HLi] 
there exists a smooth non-negative p-plurisubharmonic function it, which is zero on a 
neighborhood of K and satisfies u(x) > 0, and furthermore, if x ^ Core(X), then u can be 
chosen to be strict at x. This violates (6.6). ■ 

Definition 6.7. Given a compact subset K C X, we define the minimal p-current hull 

to be the set 

i^min = |J SU PP( T ) 

where the union is taken over all minimal T e 1Z P (X) with supp(9T) C K. 

Note that K m i n contains all compact minimal oriented p-dimensional submanifolds 
with boundary in K. 

Corollary 6.7. 

K min C KUCore(X). 

If X supports a global strictly p-plurisubharmonic function, then Core(X) = 0. For 
example, \x\ 2 is such a function on R n . 
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Question 6.8. Suppose T C R n is a compact (p — l)-dimensional submanifold which 
bounds exactly one minimal p-current in R n and that current is an oriented submanifold 
M. How close does T come to approximating M? 



General Minimal Currents 



Much of what is said above carries over to general compactly supported currents of 
finite mass. These are exactly the currents which can be represented as in (6.1) with the 
provision that the ||T||-measurable field 3* of unit p- vectors is no longer required to be 
simple ||T||-a.e.. Definition 6.1 makes sense for such currents, and the first variational 
formula 



holds. If V = Vw where u G PSH^(X), then by Definition 2.1 (3) we know that D A v > 0. 
Furthermore, at any point where u is strict, we have D^y > 0. The arguments for 
Corollaries 6.5 and 6.6 give the following. 

Proposition 6.9. Let T be a minimal p-dimensional current of finite mass and compact 
support on X , and let u be any smooth p-plurisubharmonic function which vanishes on a 
neighborhood of supp(<9T) . Then 



Thus the minimal current hull K min can be expanded to contain the supports of all minimal 
currents with boundary supported in K, and Corollary 6.7 remains true. 

Examples. Minimal non-rectifiable currents abound in geometry. Any positive (p,p)- 
current on a Kahler manifold X is minimal. This observation extends to positive (^-currents 
on any calibrated manifold (X,(j>) (see [HLo, §?]). Any foliation current whose leaves are 
minimal p-sub manifolds is a minimal current. 

There are two basic cases of smooth minimal currents which are interesting. Let T be 
a smooth enclosed current of dimension n — 1 (degree 1). Then T is simply a closed 1-form 
and can be written locally as T = df for a smooth function /. In a neighborhood of any 
point where df ^ 0, the minimality condition is equivalent to the 1-Laplace Equation: 



d 
dt 




(D nessu f,f) = \\T 



— a.e. 



Furthermore, 



supp(T) C dTUCore(A:). 
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Let T be a smooth enclosed current of dimension 1. Then T can be expressed on a 
compactly supported 1-form a as T(a) = f x a(V)dvolx where V is a smooth vector field. 
Minimality is the condition that 



which means exactly that the (reparameterized) flow lines of V are geodesies in X, and 
the (i-closed condition is equivalent to 



The concept of p-plurisubharmonicity can be carried over to upper semi-continuous 
functions, and these more general objects have proved to be quite useful. This has been 
studied in [HL 4 ], [HL 3 ], [HL 5 ] and [HL 7 ]. We give a brief summary of the known results 
here. 

Let X be a riemannian manifold an denote by USC(X) the space of upper semi- 
continuous [— oo, oo)- valued functions on X. By a test function for u G USC(X) at a 
point x we mean a C 2 -function <p, defined near x, such that u < <p near x and u(x) = <p(x). 

Definition 7.1. A function u G USC(X) is p-plurisubharmonic if for each x G X and 
each test function cp for u at x, the riemannian hessian Hess x </? at x is p-positive. The 
space of these functions is denote PSH p (X). 

The following basic facts can be found for example in [HL 5 , Prop. 2.6]. 

THEOREM 7.2. 

(a) (Maximum Property) If u, v G PSH p (X), then w = max{tt, v} G PSH p (X). 

(b) (Coherence Property) If u G PSH p (X) is twice differentiable at x G X, then Hess x -u 
is p-positive. 

(c) (Decreasing Sequence Property) If {uj} is a decreasing (uj > ttj+i) sequence of func- 
tions with all Uj G PSH p (X), then the limit u = limj^oo Uj G PSH p (X). 

(d) (Uniform Limit Property) Suppose {uj} C PSH P (X) is a sequence which converges 
to u uniformly on compact subsets to X, then u G PSH p (X). 

(e) (Families Locally Bounded Above) Suppose J 7 C PSH p (X) is a family of functions 
which are locally uniformly bounded above. Then the upper semicontinuous regular- 
ization v* of the upper envelope 




div(V) = 0. 



7. Potential Theory. 



v(x) 



sup u(x) 



belongs to PSH p (X). 
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There are inclusions PSHi(X) C PSH 2 (A) C ••• C PSH n (A), and PSH n (A) is the 
set of classical subharmonic functions on X. In particular, they satisfy the maximum 
principle. 

If u G USC(A) has the property that its (local) restrictions to p-dimensional minimal 
submanifolds are subharmonic, then u G PSH P (A). This follows from the fact that given 
any x G X and W G G(p, T X X) there exists a minimal submanifold M with T X M = W . A 
basic non-trivial result is the converse. It is a special case of Theorem 6.2 in [HL7]. 

THEOREM 7.3. (The Restriction Theorem). The restriction of any u G PSH p (A) 
to a p-dimensional minimal submanifold M C X is subharmonic (or = —00) on M with 
respect to thie induced riemannian structure. 

8. Viscosity Solutions of the Homogeneous p-Monge-Ampere Equation. 

Consider any closed subset F C Sym 2 (R n ). We say that an upper semi-continuous 
function tiona domain X C R n is F-subharmonic if for all x G X and all test functions tp 
for « at x, we have Hess^ G F. Somewhat surprisingly, the set F(X) of these functions 
enjoys all the properties of Theorem 7.2 (see [HL5, Prop. 2.6]). However, in order for this 
definition to be meaningful, F must satisfy the Positivity Condition: 

F + V^BJ 1 ) C F. (8.1) 

Then for u G C 2 (A), u is F-sub harmonic if and only if Hess^-u G F for all x G X. 

When F is invariant under the natural action of the orthogonal group, this definition 
carries over to any riemannian manifold (cf. [HL5]). 

Associated to F is the dual subequation 

F = ~ (-IntF) = -(~ IntF) 

which satisfies the Positivity Condition (8.1) if F does. Note that dF = Ffl (-F). 
Definition 8.1. A (real-valued) function u on X is called F-harmonic if 

ueF(X) and -ueF(X). 

A C 2 -function is F-harmonic if and only if Hess^-u G dF for all x G X. 
The case of interest in this paper is F = . 

Definition 8.2. A function u on X is a solution of the k th branch of the homoge- 

(k) 

neous p-Monge- Ampere equation if u is Vp -harmonic. 

If u is C 2 , then it is a solution if and only if Hess x w G dV^ for all x G X. As a result 
of (3.4) this implies that 

MA p (u) = on X 

(k) 

Since the sets Vp are orthogonally invariant, these definitions and remarks make 
sense on any riemannian manifold X using the riemannian hessian. 
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Embedded in Definition 8.2 is the requirement that — u satisfies the dual subequation 

~(k) 

Vp The dual of the subequation V p is the set 

V p = {A G Sjm 2 (V) : 3 W G G(p, V) with ti w A > 0} 

= {A G Sjm 2 (V) : X n - p+ i(A) H A n (A) > 0} 

= {AGSym 2 (y):A max ( J D j4 )>0}. 

These calculations follow from the three ways of describing V P (V) given in Definition 2.1. 

More generally, using the terminology of Section 3, the dual of V p k ^ = {A : \i k (DA) > 0} 
is 

-p( fc ) _ -p( fc *) 
' p 1 p 

where fc* = ( n ) - k + 1. 



9. The Dirichlet Problem for the Homogeneous p-Monge- Ampere Equation. 

Proposition 5.9 asserts the existence of many strictly p-convex domains. It turns out 
that on such domains one can uniquely solve the Dirichlet problem for the homogeneous 
p-Monge-Ampere Equation, in fact for every branch of that equation. 

THEOREM 9.1. Let O CC X be a domain with a smooth strictly p-convex boundary 
dQ and with Core(Q) = in an n-dimensional riemannian manifold X. Fix an integer 
k with 1 < k < (p). Then for each continuous function G C(<90), there exists a unique 

continuous function u G C(O) such that: 

(a) u is a solution of the k th branch of the homogeneous p-Monge-Ampere equation 
on Q, and 

(b) u\ dn = cp. 

Note 9.2. The hypothesis on O is equivalent to the requirement that there exists a smooth 
strictly p-plurisubharmonic function p, defined on a neighborhood of O, with O = {p < 0} 
and Vp 7^ on 90. 

Note 9.3. This theorem remains true if one replaces the operator MA p (u) = detj-Dnessii} 
with the operator cri{Dn essu } where erg denotes the £ th elementary function, 1 < £ < (™). 
In this case the cone V P (V) is replaced by the convex cone 

S p , e (V) = {A:a 1 (D A )>0,a 2 (D A )>0,...,a i (D A )>0} 

Again there are branches, and the Dirichlet problem can be solved for each of these 
branches. An important point is that V P (V) is a monotonicity cone for each of these 
equations, i.e., S p j(V) +V P (V) C S Pji (V). 

Note 9.4. For all equations except the main branch of MA p (m), Theorem 9.1 remains 
true under weaker convexity assumptions on the boundary 90 (see [HL5]). 
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All of the above represents a special case of results established in [HL 5 ]. A useful 
elaboration of the algebra involved is given in [HL 6 ] 

Note 9.5. Certain versions of the inhomogeneous equation (in the case k = 1) can also be 
solved using the notion of afhne jet equivalence. The reader is referred to [HL 5 ] for details. 

Appendix A: Extreme Rays in the Convex Cone V P (V). 

For each unit vector e G V, orthogonal projection onto the line span (e) can be written 
as the symmetric product e o e. Recall the classical fact that the extreme rays in Vi(V) = 
{A : A > 0} are exactly those generated by e o e for e G V. 

Proposition A.l. The extreme rays in V P (V) are of two types ifl<p<n — l. 

(1) \I - e o e , or 

(2) eoe 

where e is a unit vector in V. 

If p = 1, only case (2) occurs. 
If p = n — 1, only case (1 ) occurs. 

By using the natural inner product on Sym 2 (V), given by (A,B) = trAB, and iden- 
tifying G(p, V) with a subset of Sym 2 (V) via the correspondence W = Pw (orthogonal 
projection onto the subspace W), Definition 2.1 (1) can be restated as: 

V P (V) = {AeSym 2 (V):(A,P w )>0VWeG(p,V)}. (1)' 

Let V+ C Sjm 2 (V) denote the convex cone (with vertex at the origin) on the subset 
G(p, V) C Sym 2 (l/). Now (1)' is the statement that the polar cone of V+ is 

V+ = (V+)° = V P (V). 

It is easy to see that the extreme rays in V+ (the polar of V + ) are given by the orthogonal 
projections Pw with W G G(p, W). 

Proof of Proposition A.l. Given an orthonormal basis e±, e n for V, the axis p-planes 
can be written as Ej = span {e^ , ei p } with i\ < • • • < i p increasing. Let Pi = Pei 
denote orthogonal projection onto the axisp-plane Ej. Now Pj = diag(ei, e n ) G V = R n 
where = 1 if i G / and = if i ^ /. 

Under the action of O n on Sym 2 (F) the set V of diagonal matrices form an n- 
dimensional cross-section. Define P_|_ = V+ H T>. This is the convex cone on the set 
of projections -Pj = Pe t to the axis p-planes thus the Pi are the vertices of P + . The polar 
cone of P+ in T>, namely V + H T>, will be denoted by P + . It suffices to determine the 
extreme rays of the polygonal cone P + C V = R n . 

Fact 1. The vertices (or extreme rays) of P + are the matrices A = diag(Ai, A n ) G P + 
whose face 

F A = span {Pi : (P T ,A) = 0} 
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is of dimension n — 1. 

We may assume that Ai < A2 < ■ ■ • < A n . Let k denote the number of strictly negative 
eigenvalues of A. Of course, k < p. 

Fact 2. Assume A e P + . If (Pi, A) = 0, then {1, 2, k} C I, i.e., Ei contains e±, e^. 

Proof. Suppose ej ^ F/ for some j, 1 < j < k. Since A^ + • • • + \ p = and k < p, we 
have Ai p > 0. Replace i p by j, i.e., replace I by J = (I — U -fj}. This replaces \ v > 
by Aj < forcing the new trace (Pj, A) to be < 0. 

Lemma A. 2. If A e P + is extreme, then A can have at most one strictly negative 
eigenvalue. 

Proof. If A has two negative eigenvalues, then by Fact 2, each Ei with (Pi, A) = must 
contain ei and e2, i.e., Pi = diag(l, 1, ...). Hence, P = diag(— 1, 1, 0, 0) _L F^. Of 
course, A A Fa. Since P and A are linearly independent, Fa must have codimension > 2. 
■ 

Now suppose that A e "P + is one of the vertices of V + , i.e., (A.l) holds. 

Positive Case. Suppose all the eigenvalues of A are > 0. Let = Ai = • • • = A^ < A^+i < 
• • • < A n define I. For each Pj with (Pi, A) = 0, Ei must be contained in spanjei, eg}, 
the zero-eigenspace of A. In particular e^- o ej _L for j = £ + 1, n. Since these e^- are 
linearly independent, Fact 1 implies that there can be at most one of them, i.e., £ = n—1. 
Hence we may assume A = diag(0, 0, 0, 1), in which case F4 = span{F/ : n £ I}. If 
p = n — 1, then dimF^ = 1, so this case cannot occur. lfl<p<n — 2, then dimF^ = n — 1, 
so A = e n o e n can occur. 

Negative Case. By the Lemma and rescaling we may assume that 

-1 = Ai < < A 2 < ••• < A n 

(This case does not occur if p = 1.) Set Uj = Xj + i for j = 1, n — 1. 
Now (Pi, A) = implies that Fj contains e\ by Fact 2. Set 

J = I - {1} and B = diag(^i, /z n -i)- 

Then 

(F 7 ,A) = ^ -l + (Fj,F) = 

Set 

F B = span{Fj : (Pj,B) = 1 where J is increasing and \J\=p— 1}. 
Now the dimension of F B is equal to n — 1 if and only if A is extreme. This happens when 

1 

— ^2 — • • ■ — fJ>n-l — T 5 

p-1 

so that (Pj, B) = 1 for all J. Thus 

. 1 . . , p—1. 1 

A = — ei o d H e j e ji or equivalently A = —1 — e\o e\ 

P a n 



J'=2 

as desired. 



p p 
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